On rationality of VK-algebras 

Victor G. Kac*^and Minoru Wakimoto^ 



Dedicated to Bertram Kostant on his 80 th birthday. 



Absract: We study the problem of classification of triples (Q,f,k), where q is a simple Lie 
algebra, / its nilpotent element and k £ C, for which the simple IF-algebra Wfc(g, /) is rational. 



Introduction 

A vertex algebra V, used to construct a rational conformal field theory, must satisfy at least 
the following three conditions: 

(a) V has only finitely many irreducible representations {Mj}j^j, 

(b) the normalized characters Xj( T ) = tr M j e 27nr( ' Lo ~ c / 24 * ) converge to holomorphic functions 
on the complex upper half-plane C + , 

(c) the functions {Xj( T )}jeJ span an 5L2(2)-invariant space. 

A vertex algebra V is called rational if it satisfies these three properties. Recall that any 
semisimple vertex operator algebra, i.e. a vertex operator algebra for which any representation 
is completely reducible, is rational (see [Z], [DLM] ) . However, it is unclear how to verify this 
condition for vertex algebras, considered in the present paper. 

It is well known that lattice vertex algebras, associated to even positive definite lattices, are 
rational (and semisimple as well). A simple Virasoro vertex algebra is rational (and semisimple 
as well) iff its central charge is of the form c = 1 — ^ p ~^ ^ , where p,p' are relatively prime 
integers, greater than 1 (which are central charges of the so called minimal models [BPZ]). A 
simple affine vertex algebra 14(g), attached to a simple Lie algebra g is rational (and semisimple 
as well) iff its level k is a non-negative integer. (Simplicity of a vertex operator algebra is a 
necessary, but by far not sufficient, condition of semisimplicity.) 

It follows from |KWlj . Theorems 3.6 and 3.7, and [KW2], Remark 4.3(a), that for a rational 
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k of the form 

(0.1) k = —h v H — , where (p,it) = 1, u > 1, (u,£) = l(resp. = £) ,p > /i v (resp. > h) , 
u 

where h is the Coxeter number, h v is the dual Coxeter number and £{= 1, 2 or 3) is the "lacety" 
of q, the normalized character of the vertex algebra Vfc(g) is a modular function (conjecturally, 
these are all k with this property). It was shown in [KWlj . Theorem 3.6, that for these k with 
(u, t) = 1 the affine Lie algebra g has a finite set of irreducible highest weight modules {Mj}j e j 
(called admissible), whose regularized normalized characters Xj( T i z ) = trM.e 2mT ' Lo_c / 24 ' +z , 
z £ 5, span an SZ^^-invariant space (if (u,£) = £, then one has only ro(^)-invariance, see 
[KW2], Remark 4.3(a)). Conjecturally, these g-modules extend to Vfc(fj) and are all of its 
irreducible modules (this conjecture was proved in [AM] for g = 3^2) • Thus, Vfc(fl) for k of the 
form (jO.ip with (u, £) = 1 satisfy the properties (a) and (c) of rationality, but property (b) fails 
for some j £ J since Xj( T > z ) may have a pole at z = 0, unless A; is a non-negative integer. 

In the present paper we study the problem of rationality of simple PF-algebras Wk(g,f), 
which is a family of vertex algebras, depending on k E C, attached to a simple Lie algebra q 
and a nilpotent element / of g (rather its conjugacy class) [KRWJ, [KW3J. More precisely, 
we need to analyze for which triples (g,f,k) the W^{q, /)-modules, obtained by the quantum 
Hamiltonian reduction from admissible modules of level k over the affine Lie algebra g, have 
convergent characters, as the modular invariance property is preserved by this reduction. We 
call such / an exceptional nilpotent and such k an exceptional level. 

The most well studied case of VF-algebras is that corresponding to the principal nilpotent 
element / (a special case of which for q = s£2 is the Virasoro vertex algebra). It follows from 
[KWlj and jFKW] that for principal / the exceptional levels k are given by 

(0.2) k = -h v + -, where (p, u) = 1 , p > h v , u > h , (u, i) = 1 . 

it 

We expect that for the principal nilpotent /, (|0.2p are precisely the values of k, for which 
Wfe(fl)/) i s a semisimple vertex algebra. 

Surprisingly, beyond the principal nilpotent, there are very few exceptional nilpotents. We 
conjecture that there exists an order preserving map of the set of non-principal exceptional 
nilpotent orbits of g to the set of positive integers, relatively prime to £ and smaller than h, such 
that the corresponding integer u is the only denominator of an exceptional level k = —h y +p/u, 
where p > h y and (u,p) = 1. 

Note that / = is an exceptional nilpotent, corresponding to u = 1, since in this case 
Wfc(0i 0) is the simple affine vertex algebra of level k £ Z+. 

We prove the above conjecture for q ~ sl n . In this case the above map is bijective to the set 
{1, 2, . . . , h— 1}, and the exceptional nilpotent, corresponding to the positive integer u < h = n, 
is given by the partition n = u + -- - + u + s, where < s < u. 

For an arbitrary simple we give a geometric description of the exceptional pairs (k, f) in 
terms of q and its adjoint group. 

We are grateful to K. Bauer, A. Elashvili and A. Premet for very useful discussions on 
nilpotent orbits, and to ESI and IHES for their hospitality. The results of the paper were 
reported at the Weizmann Institute in January 2007 and at a conference in Varna in June 2007. 
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1 Admissible modules over affine Lie algebras. 

1.1 Description of the vacuum admissible weights. Let g be a (non- twisted) affine Lie 
algebra, associated to a simple finite-dimensional Lie algebra g |K1] . Recall that 

g = g[t,r 1 ]©a®CD 

with commutation relations: 

[at m ,bt n ] = [a,b]t m+n + m5 m ,„ n (a\b)K, 
[D,at m ] = mat m , [K,g] = 0, 

where ( . | . ) denotes the symmetric invariant bilinear form on g, normalized by the condition 
(a | a) =2 for long roots a. 

Recall that the bilinear form ( . | . ) extends from g to a symmetric invariant bilinear form 
on g by letting 

(t m a\t n b) = 6 m ,- n (a\b) , (fl[t, t- 1 } \CK + CD) = , 
(K\K ) = (D\D) = , (K\D) = 1. 

Choose a Cartan subalgebra f) of g, then 

i) = fj + CK + CD 

is an ad-diagonalizable subalgebra of g, called its Cartan subalgebra. Since the restriction of the 
bilinear form ( . | . ) to h is non-degenerate, we can (and often will) identify fj* with f), using this 
form. Given a € f) such that (a\a) ^ 0, we denote a v = 2a/(a\a), unless otherwise specified. 

Let A C f)* be the set of roots of g, choose a subset of positive roots A + , and let Y\ = 
{qi, . . . ,a r } be the set of simple roots, where r is the rank of g. Let A^ = {a v |a € A + } be 
the set of positive coroots, f] v = {a\, . . . , a^} the set of simple coroots of g. Define, as usual, 
p and p v by: 

(p|a, v ) = l, (p J \a i ) = l, i = l,...,r. 
Recall that the sets of roots A and coroots A v of g are 

A = A rc U A im , A v = A v ' rc U A im , 

where the sets of real roots and coroots are 

A re = {a + nK\a G A, n G Z} , A v < rc = {a v [a G A rc } , 

and the set of imaginary roots (resp. coroots) is 

A im = {nK\n G Z , n ^ 0} , 

the subsets of positive roots and coroots being: 

A r + e = A+ U {a + nK\a G A, n > 0} , A^ ro = {a y \a G A r + C } , 
A^ = {nK\n > 0} , A+ = A r + C U A™ , A^ = A^' rc U A^ . 
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Recall that the sets of simple roots (resp. coroots) in A + (resp. Ajj_) then are: 

= {a = K - 9, ai, ... ,a r }, Yl = {"o = K ~ ® V > a i > • • • > a r } > 

where 9 is the highest root in A+. The positive integers 

h = {p v \9) + 1 and h v = {p\9 v ) + 1 

are called the Coxeter number and the dual Coxeter number of g, respectively. 
Defining p = h y D + p, p v = hD + p v G f), we have the usual formulas: 

(p\ai) = !, (p V |"i) = 1, i = 0, 1,... ,r . 

Given A G ff, let 

A^ = {a v G A v |(A|a v ) G Z} . 
Let A^ + = ^11^ and let FJa De tne set of simple roots in A^ + . 

Definition 1.1 ([KW1]). A weight A G f)* is called admissible «/ i/ie following two conditions 
hold: 

(1.1a) (A + p|a v ) £ {0, -1, -2, . . .} /or a// a v G A^ , 

(1.1b) the <Q>-span of A^ contains A v . 

We proved in [KWlj that the (normalized) character of an irreducible highest weight q- 
module with highest weight A satisfies a modular invariance property if A is an admissible 
weight (and conjectured that for no other A this property holds). Admissible weights were 
completely classified in |KW1| . and this classification will be used in the paper. The following 
proposition describes the "vacuum" admissible weights. 

Proposition 1.1. For k G C the weight A = kD is admissible if and only if k satisfies the 
following properties (a) and (b): 

(a) k + h y = ^, where p, u G N , (p,u) = 1; 

(b) one of the following possibilities holds: 

(i) (u,£) = 1 and p > h v (in this case Y[\ = {uK — 9 V , a^, . . . ,a^}), 

^ v 

(ii) u G £N and p > h (in this case f\\ = {uK — 6^ , a(, . . . , a^}). 

Here t is the lacety of q (i.e., t = 1 for A — D — E types, i = 2 for B — C — F types, and I = 3 
for G2), and 9 S is the highest among short roots in A + . 



4 



Proof. Condition (jl.lbp of admissibility implies that (\ + p\ati) G Q for all i = 0, 1, . . . , r. This, 
together with (jl.lap for a v = nK implies (a). 

Next, note that (A+p|a v ) = (p\a v ) G Z if a G A v , hence A v C A%. Since (\+p\nK+a v ) = 
n(k + h v ) + (p\a v ) G n% + Z, we see that (A + + a v ) G Z iff n G itZ. Therefore, 

A^ = A^' rc UA^' im , where 

A^' re = {nuK + a v |n G Z , a v G A v } n A v ' rc , A^' im = {nuK\n G Z\{0}} . 
Thus, the A in question is an admissible weight iff (jl.lap holds, i.e., 
(1.2) (A + p|o v ) G N for all a G A^ + . 

Case (i): (u, I) = 1. In this case 

A^' re = {nuK + q v [n G Z , a G Aj on g} U {nluK + a v |n G Z , a G Ag^^} , 

and the set of simple roots is FJ A = {uK — 6> v , a^, . . . , a^}. 

Hence condition (jl.lap is equivalent to (A + p\uK — 6> v ) = u(k + h y ) — (/i v — 1) G N, i.e., 
p-h v G Z+. 

Case (ii): (u,£) = t. In this case 

A^' rc = {nuK + a J \n G Z, a v G A v }, 

hence Y[\ = ~ ®si Q ii • • • i a r }• Therefore, using that = (p v |#) = h — 1, condi- 

tion (TO|) is equivalent to (A + p|uif - 6^) = u(k + h v ) - (h - 1) G N, i.e., p - /i G Z+. 

□ 

1.2 Principal admissible weights. Recall the definition of the affine and extended affine 
Weyl groups. Let W C Endfj be the Weyl group of q and extend it to t) by letting w(K) = K, 
w{D) = D for all w G W . Let Q v = Ya=i ^ be the coroot lattice of 0, then P = {A G 
f)*|(A|a) G Z for all a G Q v } is the weight lattice; note that Q v cPn Q*, where Q* = {A G 
f)|(A|a) G Z for all a G Q}- Given a G f), define the translation |K1] 

f a (u) = v + (v\K)a - (^\a\ 2 (v\K) + (v\a))K , 

and for a subset L C f), let i& = {t Q |a G L}. The affine Weyl group W and the extended affine 
Weyl group W are defined as follows: 

W = W Kt Q w ,W = W v.t Q * , 

so that W C W". Recall that the group W+ = {w G W"|w(n ) = EI } ac ^ s transitively on 
orbits of AutJ} and simply transitively on the orbit of o.q, and that W = W+ k W . 

An admissible weight A is called principal if A^ is isomorphic to A v . We describe below 
the set of all principal admissible weights. 

For u G N let 

S( u ) = {uK-6 y , al,...,o%}. 
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Given y G PF, denote by P Uiy the set of all admissible weights A, such that J| A = y(S^). 

Let P (resp. P+) = {A € f)|(A|a^) G Z (resp. € Z+) for all i = 0, . . . , r} denote the sets 
of all integral (resp. dominant integral) weights. Given k G C, denote by P+, P^ , etc. the 
subsets of P+, P u ,j/, etc., consisting of all elements of level k (recall that the level of A is (X\K)). 

Theorem 1.1 QKW1]). (a) P k y ^ iff the triple k,u,y satisfies the following three 
properties: 

(i) (u,£) = 1 (recall that i = 1,2 or 3 is the lacety of q), 

(ii) k + h v = 2-, where p,u 6 N , p > h y and (p, u) = 1 , 
(Hi) y(S {u )) C A^ . 

(b) If properties (i) — (Hi) hold, then 

P k y = {y.(A + (k + h v - p)D)\A G Pr hV }, 

where y.X = y(X + p) — p is the usual shifted action. 

(c) The set of all principal admissible weights is U^^yP^yt where (k,u,y) runs over all 
triples satisfying (i) — (Hi). 

(d) Two non-empty sets P k y and P k r / have a non-empty intersection iff they coincide, 
which happens iff k = k! , u = u' and y(Sr u )) = y'{Sr u \). 

Denote by Pr k the set of all principal admissible weights of level k. Note that Pr k = 
P k +CKifk£ Z+. 

Proposition 1.2 ( |FK Wj ) . Let A G P k y , where y = tpy, be a principal admissible weight. 
Then the following conditions are equivalent: 

(i) (X\a) i 7L for all a G A v , 

(ii) y(S {u) ) C AX\A£, 

(Hi) < -{y~ l {(3)\a) < u for all a G A + , 
(iv) (P\a) £ uZ for all a G A. 

A principal admissible weight, satisfying one of the equivalent properties (i) — (iv) of Propo- 
sition 11.21 is called non-degenerate. Given y G W, denote by P^ the union of all P k y with 
y = tpy, where (3 satisfies the inequalities (iii) of Proposition 11.21 It follows from this proposi- 
tion that the set of all non-degenerate principal admissible weights of level k, denoted by Prn k , 
is the union of all P^ : 

Pm k = (J Pjj . 

yew 

Proposition 1.3 ( |K W2j . [FKW] ) . (a) P| ^ iff k satisfies conditions (QJQ . 
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(b) Provided that W.Sty holds, two sets Pg and P^ t have a non-empty intersection iff they 

coincide, which happens iff y~ x y' G W+, where W + is the image of W+ under the 
canonical map W — > W . 

(c) For A G Pg there exists a unique (3, such that A = (tpy). (A + (k + h y — p)D), 
where A G P^ , p = u{k + h y ). We let 

^y{K) = (K\uD-y- l {P)-p J )- 

This is a bijective map 

<py : i*-> Pl~ hV x PX u - h , 

the inverse map being 

i>y(K M) = y-A + (k + fc v )(I> - y(jj. + p v )) . 

(d) Given p, u G N, sitc/i £/ia£ (p, w) = 1, (£,u) = 1, p> h v , u> h, define the set 

i P ,u = (?r hV >< px u - h )/w + 

(where w(X, yu) = (w(A), w(fi)), w G W+J. Then, letting 

<p(A) = <p g (A) if At P*, 

gives a well-defined map <p : Prn k — ► I p>u . 

fej Elements A, A' G Prn k have the same image under the map ip iff A' = w.A for some 
w G W. in particular, all fibers of the map <p have cardinality \W\. 
1.3 Characters of principal admissible g- modules, their modular transformations 
and asymptotics. 

Introduce the following domain Y and coordinates (r,z,t) on Y: 

Y = {A G tj\Re(\\K) >0} = {(r,z,t) := 2m(-rD + z + tK )| r, i G C , Imr > , z G f}} . 
The product 

i? s (u) = e (^) J] (i_ e -(«l«)) JJ(i_ e -JW))r 

converges to a holomorphic function on Y. Given A G Y — p , consider the series 

N x (v) = e(w)e {w{x+ ^ v) , 

where W\ is the subgroup of W, generated by reflections r a v (defined by r a v(u) = v — (a\v)a y ) 
in all real roots from AY. This series converges to a holomorphic function on Y. 

Let L(X) denote the irreducible highest weight g-module with the highest weight A G h*, 
and let 

c ^L(x)(v) = toh(\)e v ,v G Y, 

be its character. For a function F on the domain Y we shall often write F(t, z, t) in place of 
F(2-Ki(-TD + z + tK)). 
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Theorem 1.2 ([KW1]). (a) If X is an admissible weight, then RgCh L ^) converges in the 
domain Y to the holomorphic function N\. 

(b) Let A = y.(X° + (k + h v - p)D) € P* y , where X° G P^ . Define the following 
isometry 4> u , y of f) : 

4>u, y (c^) = 2/ _1 (a 4 v ), i = l,...,r, 4> u ,y(D) = uy^ 1 (D) , (j) u>y {K) = u~ l K . 

Then 

(1-3) ch L(x) (v) = N x o((j) u Jv))/R~ s (v) . 

Remark 1.1. W\ = <f>u$V <f>u,y Using this, one derives (|1.3|) from (a). 
Define the normalized character 

(1-4) XL(x)(r,z,t) = e 2 ^ch L(A) (r,z,t), 

where 

|A + p| 2 |p| 2 

' A 2{k + hy) 2/i v ' 

and k is the level of A. Let D$(t, z, t) = glPl 3 / 2ftV R^(t, z, t) denote the denominator of Xl{\){ t i z i 
It satisfies the following well-known transformation formula [ Klj : 

(1.5) D$ (-~ , , t - = ( _ 2) |A + | ( _ ir) r/ 2 ^ (T) Zj t) 

Note that XUX) = XL(X+aK) f° r anv a € C. For that reason, from now on we shall consider 
elements of Pr fc mod CK. There is a unique representative A in each coset, such that X(D) = 
0. When writing (A|/i) for A, /x € Pr fc , we shall mean the scalar product of these representatives, 
in other words, (A|/i) = (A|/2), where the bar means the orthogonal projection of f) to h. Note 
that, by the "strange formula" |Klj . we have: 

_ (X + 2p\X) 1 A;dimg 
SX ~ 2(k + h v ) ~ 24 k + h v ' 

^From (jl.3p and the transformation formula and asymptotics for characters of integrable 
g- modules we derived those for principal admissible modules. 

Theorem 1.3 ( [KWIj ). Let X = y.(X° + (k + h v - p)D) G Pr k , where k + h v = p/u, y = tpy, 
PeQ*,y£W,X°e Pl' hV . Then 

( a ) XL{\) (-7, f , *- ^r) = EA'GPrfc«( A > A, )XL(A')( r >^)> 

ui/iere 

a(A, A') = i^n"^^^^^/^^^ 
x £ e ( w )e-^ ( - (A ° +?)|A ' 0+?) . 
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(b) As t I 0, we have for each z £ f), swc/i t/iai (a|z) ^ Z /or a// a £ A: 



where 

b(X,z) 
a(A°) 



2 Characters of W^-algebras Wfc(g,/). 

2.1 Construction of simple vertex algebras Wfc(f),/). First, recall the definition of the 
vertex algebra Wk(g, f) |KRW] , }KW3| . Let q be a finite-dimensional simple Lie algebra with 
the normalized invariant bilinear form as in Sec. 11.11 and let / be a nilpotent element of q. 
Include / in an s^2-triple f,x,e, so that [x, e] = e, [x,f] = —f and [e, /] = x. We have the 
eigenspace decomposition of g with respect to ad x: 

= Sj ■ 

Let q± = ©j>o0±i) and let A c ^ = q + + g_ with odd parity. The restriction of the bilinear 
form ( . | . ) to j4 c h is non-degenerate and skew-supersymmetric (since it is symmetric before 
the change of parity). Denote by A ne the (even) vector space 31/2 with the non-degenerate 
skew-symmetric bilinear form 

{a,b) = (f\[a,b\) , a,bGg 1/2 . 

Introduce the following differential complex (C fc (g,/), do), where 

C k (9J) = V h (Q)®F( Q J) 

is the tensor product of the universal affine vertex algebra of level k and F(q, f) = F(A C \ 1 ) (g) 
F(A ne ) is the tensor product of vertex algebras of free superfermions, based on A c ^ and A nc , 
and do is an odd derivation of the vertex algebra C k (g, /), such that dp = 0. 

In order to define the differential do, choose a basis {ua} a &Sj of each subspace Qj of g, and 
let S + = Uj>o5'j , 5 = UjSj. Then {u a } a€ s + is a basis of q + , and we denote by {u a } a( zs + 
the dual basis of g_. Let {tp a , (p a } a <=s + be the corresponding basis of A c ^ and {4> a } ae s 1/2 the 
corresponding basis of A De . Consider the following odd field of the vertex algebra C k (Q, /): 

d(z) = d st (z)+J2(f\ u *)<P a ( z )+ E ■■<P a (z)Mz)--, 

where 



Xl(\)(t, -tz,0) ~ b(\,z)e~ 



e(y)u- r / 2 a(X°) 17 sin ^ ® a) /sinvr(z|a) , 



P - r ' 2 \p/Q y \- i i 2 n 2 

1 — — ) dimg . 
pu J 



sm • 



7r(A° + p\a) 
P 
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cf\z) = ^ :u a (z)^(z):-^ £ : ^(z)^(z)^ (z) : 

and cZg are the structure constants of g : [u a ,up\ = Yly ^ a B u l ( a > ^> 7 ^ Then cfo : = 

Res 2 is an odd derivation of all products of the vertex algebra C k (g, /) and = 0. 

The homology of the complex (C k (g, /), do) is a vertex algebra, denoted by W k (g, /). 

We shall assume that k + h v ^ 0. Then one can construct the following Virasoro field L(z) 
of C fc (g, /), making the latter a conformal vertex algebra: 

L(z) = L»(z) + + L ch (z) + L nc (z) . 

Here L s (z) = 2 (k+h v ) Eaes ■ u a{z)u a (z) : is the Sugawara construction, and 

L ch (z) = Y, : 9 g <p a (z)tp a (z) : +(1 - a(x)) : «9^ Q (z)c^(z) :) , 

aeSi/2 

where is a basis of A ne , dual to {</> a } with respect to the bilinear form ( . , . ). 

With respect to L(z) the field d(z) is primary of conformal weight 1. In the language of 
A-brackets, this means that [d\L] = Xd, hence do(L) = [d\L]\\=Q = 0. Thus, the homology class 
of L defines the Virasoro field L(z) = ^2 nG zL n z~ n ~ 2 of the vertex algebra W k (g,f), making 
it a conformal vertex algebra. Its central charge is given by the following formula [KWlJ: 

1 12 

(2.1) c(g, f, k) = dim go - - dimg 1/2 - - - ^ \p - (k + h v )x\ 2 . 

Above and further on we identify the fields of a vertex algebra, like d{z) , L(z) , . . . , with 
the corresponding states d, L , . . . , via the field-state correspondence: a = a(z)|0)|«=o- 

Let gf be the centralizer of / in g. Then the ^Z-grading, induced on g-^ from g is of the 
form 

It was proved in [KW3] that the vertex algebra W (g, f) is strongly generated by dimg^ fields 
j{ a }(z), where a runs over a basis of , compatible with the above ^Z-grading, and J^ a '(z) 
has conformal weight 1 + j if a 6 g_j. 

Therefore the operator Lq is diagonalizable on W fc ({|, /) with spectrum in and finite- 
dimensional eigenspaces, the th eigenspace being C|0). Hence the vertex algebra W k ($, /) has 
a unique maximal ideal /, and Wk(g, f) = W (fl, f)/I is a simple vertex algebra. 

Given u G go, the subspaces g+ (resp. Q1/2) are ad ^-invariant; let c%(v), a, f3 € <S + ( resp. 1/2) 
be the matrix of ad v on g +{ resp . i/ 2 ) in the basis {u Q ,} Qe5+{ resp> 1/2) , i.e., [v, up] = ^2 a c^(v)u a 
Define the following field: 

J W (z) =v(z)+v ch (z)+v nc (z), 
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where 



v ch (z) = £ <$(v) : <p a {z)<fP{z) : , v ne (z) = - 1 - £ c%v) : : . 

Lemma 2.1. foj For any v G 0O; ^ have 

^ Provided that v G 0q, we /iave: 

do(J M ) = 0. 

Proof, (b) was proved in [KRW], by making use of the A-bracket calculus. The same proof 
gives (a). 

□ 

2.2 Computation of the Euler-Poincare characters in the Ramond sector. We stud- 
ied in |KW4| the most general cr-twisted modules over W (g, /). From the point of view of 
modular invariance the most important case is the Ramond twisted one, when a = an is an 
automorphism of g, defined by or = e 27nad x . 

Since or is an inner automorphism of g, we can choose a Cartan subalgebra f) of g, contained 
in go- Let A C f)* be the set of roots, and let A J C A be the set of roots of f) in g,. 

A natural choice of a subset of positive roots in A is A + = A+ U (UjxjA-?), where A+ is a 
subset of positive roots of the root system A . 

However, we shall need another choice of a subset of positive roots, which will be denoted 
by A" ew . First, we choose the element / to be a sum of root vectors, attached to roots 
71, ... ,7 S G A -1 , such that fy* := {h G h\^fi{h) = 0, i = 1, . . . , s} is a Cartan subalgebra of 
gf . Next, choose an element ho G such that a(ho) = iff aL/ = for a G A. Since the 
restriction of any root from A 1 / 2 to t)f is not identically zero [EKj . it follows that ad ho\ 8l , 2 has 
no zero eigenvalues. Finally, let Af} = {a G A°| aj^/ =0} and let Aq + be a subset of positive 
roots in the root system Aq. The new set of positive roots in A is as follows: 

A ncw = A o + y | a G A | either a ^ > o , or a(ho) = and a{x) < 0} . 

Since ho G f)^, ji(ho) = for all i, hence all 7, lie in A+ w . Also, since all elements from 0q 
define symplectic endomorphisms of g 1/2 , A 1 / 2 := A™ w nA 1 / 2 (resp. A]/ 2 := (-A^ ew )nA 1 / 2 ) 
contains exactly half of the roots from A 1 / 2 . Thus A5f w satisfies the properties, required in 
[KW3] . 

Let g R = © mG i z (flm t m ) © CK © CD be the o^-twisted affine Lie algebra (Kl], where 

0m = ©jemflj; w G |Z/Z being the coset of m G and the commutation relations are 
given by the same formulas as for g. Note that both g R and g lie in the affine Lie algebra 
g[t l l 2 , t~ 1 / 2 ] (&CK (BCD, and, in fact, they are isomorphic, g being mapped to g R by the element 
t x of the group G^C^ 1 / 2 , i^ 1 / 2 ]). Note also that they share the same Cartan subalgebra rj, and 
that A R = t x (A) is the set of roots of g R . 



11 



For each a G A define the number 



, new 



s a = -a{x) if a G A° ew , = 1 - a(x) if a G -A 1 : 

and introduce the following set of positive roots in the set A^ of roots of 

A+ = {(n + s a )K + a| a G A , n G Z + } U {nif| n G N} . 

Let A R (resp. A^) = {-a(x)K + a\ a G A (resp. A^ ow )} C A R (resp. A^). Let 
A R ' j = {a G Af |(a|x) = j}. Let A R,/ (resp. A+ J ) = {a £ A R (resp. A^)| a| b / = 0}. 

Lemma 2.2. faj There exists w G W, sitc/i that A R = t x w(A + ). 

(b) A° ow = w(A + ). 

(c) If g G g^, i/ien (a;|<?) = 0. Consequently, C t x w(t)). 

(d) Let Y\ R be the set of simple roots for A5- Then A 1 }'* n Y\ R is the set of simple roots 
for A RJ . 

Proof. Let J] = = s^K + (3i\ i = 0, 1, . . . , r}, where G A, be the set of simple roots of 
A+. We have: K = ^ where o« are positive integers. Recall also that sp. = —f3i(x) + ni, 
where rii = or 1. 

Since (x|i^) = 0, it follows that: 

aj/3j = and a^nj = 1 . 
i i 

It follows from the second equation that there exists index io such that aj = 1 and ni = Si^ . 
Hence {/3j}j^j is a set of simple roots for A and = —j3i{x)K + = i,;/^ for all i 7^ io- Hence 
there exists u) G W, such that {/3j}j^j = ^(n)i where n is the set of simple roots of A + . 

_^ 

Therefore {/?i}i^i = ^"^(11) an< ^ hence = tj;U)(n), where Y\ is the set of simple roots of 
A + proving (a). 

By the proof of (a), /3j G A^ ew if i ^ iq. Hence, by the construction of w, (b) follows. 

Since x = [e, f], we have: (x\g) = ([e, f]\g) = {e\[f,g\) = if g G g f , proving (c). 

R f f? 
In order to prove (d), we need to show that if a G A + and a = f3 + 7, where /?, 7 G A^;, 

then /?, 7 G A + '- y . Evaluating at /io, we have: = a(/io) = P(ho) + 7(/io)- But both summands 
on the right are non-negative, by definition of A^ ew and A^. Hence /3(/io) = 7 (ho) = and the 
restriction of (5 and 7 to is zero. □ 



We have: A^ = t x w(A+), A R = t x (A), A R = t x w(A + ). Let p R = t x w(p), i) R = t x (t)), 
D R = t x (D), W R = t x Wt x l , P+' R = t x w(P^), Pr k ' R = t x wPr k , etc. Then W R = W R x t Q v, R 
is the (affine) Weyl group of W R = W R x t P n is the extended affine Weyl group, rj = 
t) R + CK + CD R is the "standard" decomposition of the Cartan subalgebra f) of g^, etc. 

Consider the triangular decomposition g R = ri R + f) +n+, corresponding to the set of positive 
roots A^, and let M be a highest weight J^-module with highest weight vector va, annihilated 
by n^, where A G h* has level k. By |GK2| . R^nchM converges to a holomorphic function in 
Y + , which extends to a holomorphic function in the domain Y. 
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The g^-module M extends to a cr^-twisted T^ fc (g)-module by the map: 
e a ^e R {z):= £ (e/)^"" 1 , h ~ h R (z) = J>t n ) 

ne(a]a:)+Z n£Z 



z -n-l 



where e a is a root vector of g, attached to a £ A, and h 6 t). Likewise we have the OR-twisted 
F(g, /)-module F r (qJ), given by (p a i-> ip R (z) := EneaM+z^™) 2 ^ -1 ' V?" ^ <P a ' R (z) ■= 
Y,nea(x)+z( l P atn ) z ~ n ^ 1 > and 0a ^ 0«(» := Enei/2+z (<M n )z~ Tl ~ 1 , generated by the vacuum 
vector 10)^, subject to the conditions tp a t n \0) R = Lp- a t n ~ l \d) R = (j) a t n \Q) R = if a + nK G A^ 
[KW4]. We thus obtain the cr fl -twisted C fc (g, /)-module C fl (M) = M ® ^(fl, /)• 
Introduce the charge decomposition 

C R (M) = @C R (M) 

mSZ 

by letting charge M = 0, charge |0}^ = 0, charge ip R = 1, charge tp a ' R = —1, charge 4> R = 0. 
The most important a^-twisted fields of C R (M) are: 



-n-2 

/6 



d^^(z) = ^^-"" 1 , L^L R {z) = Y,L R z 

nSZ rt£Z 

jW ^ = £ jW-V- 1 (hef)). 

ngZ 

Since (d R ) 2 = 0, we obtain a complex (C R (M),d R ), where d£ : C*(Af) -► C^.^M). The 
homology of this complex is canonically a u^-twisted W (g, /)-module 

H R (M) = @ H R (M) , 

m&Z 

where all H R (M) are submodules (see [KW4| for details). 

Recall [KRWJ that with respect to Lq the fields e a (z), h(z), (p a (z), f a (z), <j) a (z) have 
conformal weights 1 — a(x), 1, 1 — a(x), a(x) and a(x) = 1/2, respectively. Writing the 
corresponding twisted fields in the form a(z) = a n z~ n ~^ a , where A a is the conformal 
weight of a(z), we obtain: 



e R (z) = Y. e ^- n ~ l+a{x \ h R (z) =Y,h n z~ n -\ = I>«,n 



y n—l+a(x) 



n&L ngZ 



Lemma 2.3. Let v = v A ® \0) R G M (g> F r (q, /). Then 

e a>n v = if a G A^ w , n > (resp. a G -A™ w , n > 0) , 
h n v = 5o tTl A(h)v if h G f) , n > , 
<p a ,n{° r <t>a,n)v = i/ct £ A° cw , n > (resp. q G -A° ew , n > 0) , 
y«v = Oifae A* cw , n > (resp. a G -A° ew , n > 0) . 
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Proof. It follows from the fact that e a>n v = 0, (p a ,nV = and <j> a>n v = if n — a(x) > s a , and 
(p^v = if n — a(x) > —s a by the construction of and of F r (q, /), see |KW3| . □ 

As usual, define the Euler-Poincare character of H R {M) by the following formula: 

ch HR{M) (r,z,t) = e M ^(-l)-tr H K (M) q L o R e 2 -4 z} ' R , 

where q = e 2mT , r lies in the complex upper half plane C + , t E C and z € . 
By the Euler-Poincare principle we have 

cn .ff«(M)( T >M) = ch C jj (M )(r, z,i) for r € C + , z G h / , t € C. 

Unfortunately, the right-hand side converges only for generic z £ | and may diverge for all 

zetf. 

To get around this difficulty, we use a trick similar to the one employed in [FKWJ. 

Definition 2.1. An element f of q is called a nilpotent element of principal type if f is a 
principal nilpotent element in the centralizer oftf (equivalently, if A[j = $). 

Recall that in q = s£ r +i all nilpotent elements are of principal type, but in general this is 
not the case due to existence of non-principal nilpotents / with fj-< = 0. 
Introduce a bigrading 

C R (M)= C m , n , 

by letting 

deg^A® |0)fl = (0,0), dege a t n = (a(x),-a(x)), deg ht n = (0, 0) , 
deg ip a t n = (q(x) - 1 , -a{x)) = - deg ip a t n , deg <£ a t n = (0, 0) , 
and introduce the ascending fibration 

Fp = C min , p G — Z . 

It is clear that d R : F p F p+ i, hence we have the associated graded complex (Gr C R (M) = 
©pelz-fp/ '-Pp-i/2 i Grd R ). It is also clear that 

Gvd R = 4' R . 

We thus obtain a spectral sequence with the first term (Ei = Gr C R (M) , d^' R ). 

First of all, we need to show that this spectral sequence converges. For this (and for 
computation of characters) we need the following commutation relations. 

Lemma 2.4. (a) With respect to ad L R all operators e R n , <p R n , ^Pn' R o-nd 4> R n are 
eigenvectors with eigenvalue —n. 
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(b) With respect to ad Jq with h G t) the operators e R n and ^ n have eigenvalue 
ct(h), and ifn' R has eigenvalue —a(h). 

(c) With respect to ad jQ h ^' R with h G (resp. to ad Jq i/ie operators <j> R n have 
eigenvalue a{h) (resp. 0). 

Proof, (a) follows from the fact that L R is the energy operator, (b) is (2.11) from |KRWj . the 
first part of (c) is (2.12) from |KRW] and the second part holds since x ne (z) = 0. 

□ 

The following lemma implies the convergence of our spectral sequence and the convergence 
of the Euler-Poincare character of E\ . 

Lemma 2.5. Let f be a nilpotent element of g of principal type. Then we can choose hi G 
such that at(h') > for all a G A^ ncw = A n A° ew . 

(a) Common eigenspaces of L R , jQ h °^' R and jjj h ^' R in F p are finite- dimensional for each 
p£±Z. 

(b) Common eigenspaces ofL R , jQ h °^' R , jQ h ^ ,R and Jq X ^ ,R in E\ are finite- dimensional. 

Proof. The space C R (M) is obtained by applying to v\ ® \0)r products of some number of 
operators of the following form (see Lemma 12.31) : 

(1) e a , n with a G A™ w , n < 0, 

(2) e a)n with a G -A* ew , n < 0, 

(3) h n with h G t), n < 0, 

(4) ip^ n with a G A° ew , n < 0, 

(5) ip atn with a G -Af w , n < 0, 

(6) with a G A* ew , n < 0, 

(7) a , n with a G -A* cw , n < 0, 

(8) y£ with a G A* ew , n < 0, 

(9) y£ with a G -A^ ew , n < 0. 

By Lemma f2.4( a). only application of the operators of the form, e_ a> o with a G A^ ew , c^_ Qj o 
with a G A° ew , (j)-a,o with a G A" ew , and </?° with a G A" cw may produce infinitely many 
states in an eigenspace of L R . Furthermore, by Lemma [2.4f b). application of all these operators 
to an eigenvector of jQ h °^' R changes the eigenvalue by a non-positive quantity. Since a(ho) > 

1/2 

for a G A + , we conclude that the operators 4>- a ,o with a G A+ ew change the eigenvalue of 
j{h },R ^ a negative quantity. 
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Furthermore, application of the operators e_ a) o with a G ^^ new change the eigenvalue of 
j{h },R ^ a negative quantity —a{h'). 

Finally, application of the operators e_ a> o with a G A° ew either changes the eigenvalue of 
ji h o}> R by a ne g a tive quantity or else does not change this eigenvalue, but changes the degree 
of the filtration (resp. the eigenvalue of Jq X ^' R ) by a positive quantity. 

This proves both statements of the lemma. 

□ 

Now we are in a position to compute the Euler-Poincare character ch H R^ M ^{T, z, t), where 
z G fyf , assuming that / is a nilpotent element of principal type. From now on we shall 
assume that / is a nilpotent element of principal type, when talking about the Euler-Poincare 
characters. 

First, note that, by Lemma [2.5f a) our spectral sequence converges. Hence, by Lemmas l2.5f b) 
and !2.1( a). we have: 

ch HR{M) (T,z,t) = e 2 ^' lhn ^(-l) m tr c a (M) q L o e 2 ^ Z+EX> ' R . 

Since L R = L^ R — xq + L^ ,R + L^ e ' R , we obtain that the right-hand side is equal to the product 
of e 2mkt and the following two expressions: 

Lg ,R -x 27ri(z+ex)o 



/ = limtr M q x °e 

€— >0 



T ch,R . r nc,R .// . \ch,R . / . \ne,i?\ 

II = limstr F R (gJ) q L ° +L ° e 2n « z+ex ^ +( z +^)o ), 

where str stands for the supertrace. 

We let S+ = A + \A^_ for short (which is consistent with our earlier notation). 

Lemma 2.6. (a) The constants s s , s ne and s c h, introduced in \KWJ$ , Proposition 3.2, 
for arbitrary a, are given by the following formulas for a = o~r: 

v 

2 



' Sne = ~Tq dim01 /2 > s ch = (fi\x) -~2^ X 



k + hy 

(b) The element 7' G I)*, introduced in \KW1$ , Corollary 3.1, is given by the following 
formula for a = gr: 

j = s a a - p . 

a<=S+ 

Proof. Formula for s g follows from |KW4j . formula (3.9), using that 



(which follows from s a + S- a = 1) and s a = if a = A ^. 

( t 1/2 

Formula for s ne follows from that in [KW4], formula (3.10), since s a = ±1/2 for a G A J . 
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Since s a = —a(x) or 1 — a(x), each summand in [KW4] . formula (3.11) for s c h, equals 
a(x)(l - a{x))/2. Hence s ch = \ J2 a eS+ a ( x ) ~ 3 E oe s + a ( x ) 2 = (p\ x ) ~ VM 2 > proving (a). 

Next, by definition, we have: V = 5 Sag,s + uA° ( s « a + S- a (— a)). Since s a + s_ Q = 1 and 
s a = if a G A°, we obtain: 7' = Eq G s+ s " a ~ 2 EaeS+uAO proving (b). 



□ 



Lemma 2.7. (aj p K = h v D - 7' + (E«e5 + - p(x) + ^{x^K. 



0>) i ^^ 1 +^ = ^?-MD)foranyAel 
Proof. By |KW3] , Corollary 3.2, we have: 

p R = h v D -j'-\-aK for some a G C . 
In order to compute a, recall that 

p R = t x w(p) = t x w{h y D + p) = h y D + h v x + w{p) - (^-M 2 + {x\w{p))K . 
Comparing with the first formula for p R , we get: 

—7' = w(p) + h v x and a = — ^~N 2 ~~ (™(p)\ x ) • 

Hence a = ^-\x\ 2 + (^'\x). Substituting 7' from Lemma l2"Ul fb). we obtain (a). 
We have by definition and (a): 

A = kD + A + (A\D)K, 

p R = h v D + f- + (J2 a(x)s a -p(x) + ^-\x\ 2 )K. 
aes+ 

Hence 

( A > A + 2 ^) - ( A I A + ^) + _J_ ( V a(x)s - o(x) + ^\xA + A(D) 

Adding to both sides s s and using in the left-hand side the formula for s g , given by Lemma r2.6f a). 
we obtain: 

(A\A + 2p R ) (A^+2g) k 

2(k + hy) [ >~ 2(k + W) +S s + fc + / l v A ' 

where A = ^aes+ (C2) + a ( x ) s a) — p(%) + ^-|^| 2 - By definition of s c h given by |KW4] . 
formula (3.11), and the third formula of Lemma l2.6l fa). we obtain that A = 0, proving (b). 

□ 

Lemma 2.8. (a) On the g R -module M (with the highest weight A) we have: 

R _ (A\A + 2p R ) 
L ° ~ 2(k + hV) hl ~ D - 
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(b) For z € t)f we have: 



II = q s ch+^e e "£ aS A 1/2 »a«(*)+2^(P W-PW) 



/ II 1,1 — e 



1/2 

CO 

-2iria(z) ^mult a J^J(1 



r,3\-r 



n 



-27rja(z)"\—l 



aeA 



a(x)=0,-l/2 

Proof. By [KW4J, Proposition 3.2 and Corollary 3.2, we have: 



1 



2(/fc + /i v , 

/(A|A + 2^) 



Hence, by Lemma 12.71 
Since Lq'^ = — D + const, (a) follows 



A| 2 + 2(A|p R )) + s J v A . 
A(D)) v A . 



By Lemmas 12.31 12.41 and [KW4J, Proposition 3.2 and Corollary 3.3, we have: 



where 



ch F fl(r, z + ex) = J] (l - q n e ^M*+™) 



Hence 



a€S+ 
n>-s a 



II 



M _ gn e -27riQ(2+e2:) 



n>— s_ c 



n>—s a 



7 s ch"t" s nc ^j 71 "^ E„ CA 1 («)+27Ti(r-p)(«) 



n a 

q(i)|>1 



n p 

a£A^ 
a(x)=l/2 



-rD + je) 



which proves (b). 



□ 



Lemma 2.9. (ty E ae aV2 s a a(z) = - E aeA V2 «W if z e t) f . 

(b) All the QQ-modules Qj are self-contragredient. In particular tr 0j ad a = /or a// a € 0q 
and j G |Z, and p(z) = \ J2a£A° + a ( z ) f or z e & • 

1/2 1/2 

Proof, (a) follows from the fact that s Q = —1/2 (resp. = 1/2) if a € A + (resp. A_ ). 

In order to prove (b), note that the Qq- (even go-) m odules Qj and Q-j are contragredient since 
they are paired by the invariant form ( . | . ). On the other hand, (ad f) 2 i gives an isomorphism 
of the gQ-modules Qj and Q-j. 

□ 
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Lemma 2.10. {a\^ \a G A^ , a(x) = 1/2} = {a\y \a G A^ , a(x) = -1/2}. 

Proof. Recall that A 1 / 2 = Af UA^ 2 and s Q = =pl/2 if a G A± /2 . Therefore, if a G A± /2 , then 

±(a — if/2) G A+. On the other hand, by Lemma l2T97 b). A+ 2 |j,/ = — A^ 2 |^/, which proves 
the lemma. 

□ 

Note that the L>-operator for the cr^-twisted affine Lie algebra g R is 

D R := t x w(D) = D + x - ^^-K . 

Let 

i2g H = e ^ [J (1 - e " a ) mult a 

be the Weyl denominator for g R . Using Lemmas 12.81 and 12.91 we can rewrite ch H R^ M ^ as follows 
(here and further z G f)-^): 



(2.2) ch^ (M) (r,M)=?^^- |( *^^ 



/ \ 

-R^rcIia./ 

V a(a)=0,-l/2 / 



(2vri(-rL» iJ + z + tis:)). 



This formula makes sense since a\^f ^ if a(x) = because / is a nilpotent element of principal 
type, and a\^f ^ if |ck(x)| = 1/2 for any nilpotent / [EK]. 
Formula (12. 21) implies the following corollary. 

Corollary 2.1. The minimal eigenvalue of L R on H R (M) equals 

(A|A + 2p R ) /llnJi , k 

All other eigenvalues are obtained from this by adding a positive integer. 

By the general principles of conformal field theory, define the normalized Euler-Poincare 
character by: 

XH*(M)(T,z,t) = e-^< 8 ' f ^ch HR{M) (T,z,t) . 
Using (|2.ip and Lemma l2~BT a). we obtain: 



1 k 1 \p\ 2 

:c(g,f,k) + s ch + s ne --\x\ 2 = - — (dim go + dim 01/2 ) + 



24 ' 11U 2' 1 24 v ou ' "''^ ' 2(fc + /i 

= dim0^ + ' 



24 ° 2{k + h y ) 



19 



(Recall that dimg-f = dim go + dimg^-) Using this, we can rewrite (|2.2p as follows: 

/„,v / ,x B A (T,Z,t) 

(2-3) XhR(M) ( r , z, t) = — ^ ^ , 

where 

|A+P fl ! 2 

(2.4) B A (r,z,t) = qW+* v ) (R~ RC h M )(2iri(-TD R + z + tK)) 

is the numerator of the normalized character xm of the g-module M (with highest weight A of 
level k) and 

oo 

x n( 1_ ^) r I I ( X - e 2wia{rDR - z) ) . 

a(a:)=0,-l/2 

Using Lemma 12.101 we rewrite the last formula as 

(2.5) tf(r,z,t) = e^^^e*^?^? 1 ^ 

oo 

x n^ 1 "^^ II (l-q n ~ 1 e~ 27Tia( - z) )(l-q n e 27ria{z) ). 
n=l aeA ^°UA^ 1/2 

If A E Pr k and M = L(A), the numerator B A is explicitly known (see Theorem II .2|) : in 
[KWlJ, §3 one can find an explicit expression in terms of theta functions: 

B A (r, z, t) = A A o +? (ur, y-\z + T 0),±(t+ (z\P) + iff )) ,z€l) f , 

where A\(t, z, t) = J2weW e ( w )®w(X)( T i z i t) ( c f- [KlJ, Chapter 13). Dividing and multiplying 
the right hand side of ([23]) by A ?R (ut, y~ l {z + t(5) , ±(t + + ^)), we obtain: 

t[/?| 2 C(t z i) 

(2-6) X H R(l(A))(t, z,t) = XL«(A0)(nr,y- 1 (z + r/9), -(* + + J|L)) l ' ' ' ; 

where 

C("T, 2, t) = dim 0e 2^((p«|j7- 1 ( Z +r/3))+^(t+( Z |/3)+^)) 

Remark 2.1. (a) Since g-^ and go + S1/2 are isomorphic as ^-modules, we have: 

(1 - q n ) r \\ (1 - q n e- 27via ^)(l - q n e 2wia{z) ) = det g/ (l - q n e 2wiz ), z G f)A 
aG A*>°uA*< 1/2 

Let p* (z) = I J2 a&A R,o uA R,i/2 ct(z), z € f)* . Thus, formulas (| 2 . 3 1) - ()2.5[) mean that the quantum 

Hamiltonian reduction of the g^-module M to the Wfc(g, /)-module H R (M) does not change 
the numerator of its normalized character, but "reduces" its denominator, replacing g by gA 
(b) The product in C(r,z,t) is equal to n«i=A fl (1 ~~ e _a ) multo (r, z, 0). This follows from 

A,+ 

formula (|2.1ip below. 
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2.3 Modular invariance, asymptotics, conditions of vanishing and convergence 
of normalized Euler-Poincare characters in the Ramond sector. Formula ()2.5f) can be 

rewritten again in terms of the Dedekind ^-function 77(7") = g 1//24 n^=i(l ~~ Q?) an d the following 
modular function in r G C + , s G C: 

00 

(2.7) /(r,s) = eTe™ J](l - oV™)(l - c^V 2 ™) 

n=l 

as follows: 

(2.8) V(r, z, t) = e^ ihVt rj(rY ]J /(r, a(z)) . 



Lemma 2.11. (a) One has the following transformation properties: 

n ( --) = (-^r) 1 /2 ^?(r) if (-l t l) = -ie- 2 / V(T) s) . 



t / v r r 



^4s r I ; one /ias: 

V (t) ~ (-i T )-V2 e -«/12r j /(T) _ ar) _ 2(sin7ra)e-^ /6T , a G 

Proof. By the Jacobi triple product identity, one has: 

f(r,s) = 6(t,s)/t)(t) , where 

00 

0( T)S ) = e ™(^4+s) _ q n )(l - q n e 2ms ){l - ^-V 2 ™^ 

n=l 

= ^(_ 1 )n-l e 27ri S (n-l/2)^(n-l/2) 2 /2 



Now (a) follows from the transformation formula for theta-functions (see e.g. |Klj . Chapter 13 
for details). 

(b) follows from formulas in (a) with r replaced by — 1/r. □ 
Assuming that k 7^ 0, define the following quadratic form on t)f; 

Q(z) = k -±^(z\z)- 1 - £ a(zf. 

aeA«>°UA«< 1/2 

Now we can prove a modular transformation formula for the normalized Euler-Poincare charac- 
ters Xh r (L(A)) j where A runs over the set Pr k,R ( mod CK) of all principal admissible weights 
of level k of the affine Lie algebra g . (The assumption that k 7^ is not restrictive since 
Prn°' R {g,f) = if / ^ 0.) 

Theorem 2.1. For A G Pr k ' R one has: 
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(a) XH*(L(A)) (-hh t - g £ l ) = (-i)^ (dim0 " dim9/) EA' e p rfc .«a(A,A')x^(L(AO)(^^O, 
where a(A, A') is as defined in Theorem \1.3]f a). 

( b ) Xh«(l(A))( t + l,z,t) = e 27ris AXH«(L(A))( r >M); where s{ = Jjffiff) - A(D R ) - 
^dimgA 

Proof. Since = Xl(A)DqR , we have from Theorem 11.3( a) and (|1.4|) : 

s A (-i ! ^i-^)=H) |A+l H>) r/2 E a(A,A')iMw). 

Hence 

(2.9) B A f_I,£,i_ = H) |A + | ( _^ ) r/2 e f( fe+/l v )((z|z) _ Q{ , )) 

\ r r 2r / 

a(A,A!)B A ,(r,z,t). 



x 

A'£Pr k ' R 



Here we used also that the only dependence of B\ on t is the factor e 2m (k+hy)t ^ On the other 
hand, using formula (|2.8p for ip(T,z,t) and Lemma T2.1 U fa) . we obtain: 

(2.10) ^(_i,£ )t _^r\ = H) iAruAr /2 i e -^w 

y r r 2t y 

xe Q£A + UA + ip(r,z,t). 

Now (a) follows from (|X5|) . (pO)) . (pETO]) . the definition of Q(z) and the fact that dimg^ = 
dim so + dimg 1/2 = 2|A° U A+ /2 | + r. 

(b) follows from ([13]), @3J, ([23]). □ 

Theorem 2.2. For £/ie principal admissible weight A = (igy).(A + (fc + /i v — p)D R ) G p r k > R ) 
where y G W^,/? G Q* ,jR ; k + h v = p/u, A G pP- hV ' R ; one has for each z G , as r | 0: 



ch H «(i(A))(^-^,0) ~e(y)u r/ ^a(A u )^(z) e i2 



n p 9 sin ZL<>!£z£> 



n aeA «,o uA «,i/2 2sin7r(a|z) 
and a(A°) is i/ie constant defined in Theorem \ 1.3( b). 

Proof. Using Lemma l2.2f b) and Lemma 12.11( b) we obtain from (12. 8p and a similar formula for 
DgB (or (USD): 

Dq R (t,-tz,0) ~ (-ir)" r / 2 J] 2sinvr(a|z)e-^ dims , 



■0(t, — Tz, 0) ~ (— it) r / 2 J~J 2sin7r(a|z)e" 



* G A«>°uA^ 1/2 
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The asymptotics for the numerator of c^h r (L(A)) ( r ' ~~ TZ i 0) follow from the first of these formulas 
and Theorem ll.3( b). Now Theorem 12.21 follows, using the second of these formulas. 

□ 

Given A G (f, let A^ = A R n A R , and Af + = A^ n Af . 
Lemma 2.12. Let A 6e as in Theorem \2.2\ Then 

{a G A R \ (a\(3) G uZ} = . 
Proo/. Let A^ = {7 + nuK\j G A R , n G Z} U {unK\n G Z , n 7^ 0}, and note that 

(2-11) Af = ^(Af u) ). 

Let a G A^ be such that (a\/3) = un for some n G Z. Then a = tp (a + unK) G ig(A^) = AjJ, 
which proves that a G A^. 

Conversely, if a G A R , then a G tp{A R u ^). Hence a G ^(7 + nuK) for some n G Z, 7 G A R , 
that is, a = 7 + (nu — (/3\j))K. Since a G A fl , it follows that = 7 and = nu. 

□ 

Theorem 2.3. (a) Let M be a restricted^ -module, and assume that R^nch.M converges 
to a holomorphic function on Y. Then ch^-A^ is identically zero iff there exists 
a G A^, such that 

(i) a\y = (=> \a(x)\ > I), 

(ii) RgRchM vanishes on the hyperplane a = 0. 

(b) Let A be as in Theorem \2.2\ Then dh-H R (L(A)) = ® iff there exists a G A R such that: 

(i) a\ ¥ = f=> \a(x)\ > I), 

(ii) (a\/3) G uL. 

(c) Let A be an admissible weight. Then &1h r (l{A)) ^ s n °t identically zero iff A R + C 
A R \A R 'f, where A R 'f = {a G A R \ a\y = 0}. 

Proof, (a) follows from the character formula (|2.2p . Condition (i) implies that |o;(ic) | > 1 since 
/ is of principal type, hence a\u 7^ for a G A , and a\^j 7^ for a G A^ 1 / 2 for all / [EK| . 

In order to prove (b), note that by Theorem II. 2f a). RgRch L ^ vanishes on the hyperplane 
a = iff a G A R . Now Lemma 12.121 and (a) imply (b). Due to Theorem ll.2f a). (c) is an 
equivalent form of (a) in the case when M = L(A), where A is an admissible weight. 

□ 

We call a weight A G Pr k,R nondegenerate for W k (g,f) if (AxgarLCA)) 7^ 0> anc l denote the 
set of all such weights by Prn k,R (g, f). 

Given A G f)* of level k, denote by h\ the eigenvalue of L R on v\ <8> |0). Then we have the 
eigenvalue decomposition with respect to L R : 

H R (L(A)) = H R (L(A))j , 
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hence the decomposition of the Euler-Poincare characters: 

<& H R im) = e 27Tikt £ 

j£h A +Z+ 

where ch^ fl(L(A))j = e 27Tikt q j ip A . j(z). It follows from Theorem [L2(a) and formula (|2.2p that, if 
A is an admissible weight for all functions ipA,j(z) are meromorphic on I)*, and for j = h\ 
we have (z € t)f ): 

Definition 2.2. We say that ch H R^ L ^^ is almost convergent if lim z ^Q (p\^f lA (z)\ f) f exists and 
is non-zero. (The first condition is necessary for the convergence of ch H R^ L ^^(T, 0,0), and the 
second condition is sufficient for its non-vanishing.) 

Theorem 2.4. Let A be an admissible weight for g R . Then 

(a) ch H R( L ( A ^ is almost convergent iff 

(2.12) I a £ +} = { m a a lf)/ I a £ A^'° U A^' 1 / 2 } (counting multiplicities), 

for some non-zero m a G Q (it is easy to show that m a > 0). 

(b) (PA.h A ( z ) * s n °t identically zero iff c^h r (l(A)) ^ s n °t identically zero. 



Proof. We rewrite the formula for <fA,h A ( z ) as follows: 



<PA,h A ( z ) 



FUa« + (1 " «*-*««(««) n Q6A? o uA? i/ 2 (l - er^aW) ' 

Since contains all reflections in a € A^ + the first factor is holomorphic in z G f)-' , and, by 
the usual argument, its limit as z — > is equal to n^eA^ / ai? l a )/(/ 9 ^l Q; ) 7^ 0- (a) follows, 

(b) follows due to Theorem 12.3( c) . 

□ 

Corollary 2.2. A necessary condition of almost convergence of ch H R( L r^\\ } where A is an 
admissible weight, is: 

|A£| = |A UAV2[. 
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2.4 Characters of the principal VF-algebras. In this section we consider in detail the case 
when / is a principal nilpotent element of g. Recall that these are elements of an adjoint orbit, 
whose closure contains all nilpotent elements of g. Recall that in this case x = p v , y = 0, 
0o = f), hence A = 0, and g 1/2 = 0, hence A 1 / 2 = 0. Hence h = and A^_ ew = w (A+), 
where wo is the longest element of W. Thus, the quantum Hamiltonian reduction, considered in 
this paper, coincides with the " —"-reduction of [KRW]. The corresponding Il^-algebra, called 
principal, will be denoted by W (fl), and its simple quotient by W&(g). 

By results of Arakawa [A2j . a non-zero iy fc (g)-module H R (L(A)) is irreducible and co- 
incides with H°' R (L(A)). Hence the Euler-Poincare character ch-jjRfL(A)) ^ s the character of 
this module. Hence chH R (L(A)) = iff the W fe (g)-module H R (L(A)) is zero. It follows from 
Proposition 11.21 and Theorem 12.3r d that for a principal admissible weight A of q r we have: 

H R (L(A)) = iff (A|a) G Z for some a G A v . 

The remaining principal admissible weights A are called non-degenerate and the corresponding 
II /fc (g)-modules H R (L(A)) are irreducible. By Proposition 11.31 the set of such A, denoted by 
Prn k,R , is non-empty iff k satisfies conditions (10. 2ft : 

k + h y = p/u , where p, u G N , (p, u) = 1 , (£, u) = 1 , p > h w , u > h . 

It follows from |FKWj that the irreducible H /fc (g)-modules H R (L(A)) and H R (L(A')) with 
A, A' G Prn k ' R = Prn k are isomorphic iff <p(A) = y?(A'), where 

<p : Prn k -» / p , n = (P^ x P^)/^ + 

is the surjective map, defined in Proposition 11.31 

Formula (|2.ip for the central charge of these H /fc (g)-modules becomes: 

pu 

The normalized character of the irreducible VK fc (g)-module H (L(A)), parameterized by 
<p(A) = (X,fJ,) G Ip. u , is given by the following formula [FKW]: 

the minimal eigenvalue of Lg 2 being 

= ^"(1^ + ^ ~P(A + P V )| 2 - kp-PP V | 2 )- 



It follows from Theorem 12.21 that, as r j 0, 

XA, M (r)~(np)- r / 2 |P/Q V r 1/2 II 4sin 



p u 



A formula for modular transformations can be found in [FKWj . 

Conjecture PA. If A G Prn k > R , then the VF fc (g)-module H R (L(A)) is actually a Wfc(g)- 
module (defined, up to isomorphism, by ip(A)), and these are all irreducible Wfc(g)-modules. 

Conjecture PB. The vertex algebra Wfc(g) is semisimple iff k satisfies ()0.2p . 
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2.5 Conjectures. Consider the space of meromorphic functions in the domain Y with the 
following action of 

, x/ x (ar + b z c(z\z) \ fa b\ „ r ,_. 

(9 ■ X)(r,z,t) = X — —3 , — —7 ,t - y ' > ,g=[ GSL 2 Z . 
\ cr + a ct + a 2(cr + a) J \c a J 

We call a function % from this space modular invariant if the C-span of the set of all functions 
{d ' x}geSL 2 (Z) is finite-dimensional. It follows from Proposition 11.11 and the results of [KW1], 
Theorems 3.6 and 3.7, and [KW2] . Remark 4.3(a), that the function XL(kD) is modular invariant 
if k is of the form (jO.ip . Moreover, if k is of the form (jO.ip with (u,£) = 1, then Xl(\) is 
modular invariant for all A E Pr k , simply because \Pr k mod CK\ < 00 and the C-span of 
{Xl(\) \^ G Pr fc } is S'L2(Z)-invariant (cf. Theorems 1 1 . 1!{L3]) . 

Conjecture A. If XL(kD) is modular invariant, then k is of the form (10. lj) . 

It has been established recently [GK2| that the character of any highest weight g-modulc 
of non-critical level k ^ —h v is a meromorphic function in the domain Y. It follows from 
[GK1] that for non-critical k, XL(kD) can be modular invariant only for k = —h w +p/u£, where 
(p, u) = l,u > l,p > 2. Thus, the first unknown case is g = s/3, k = —1. 

Conjecture B. 

(a) If M is an irreducible highest weig ht g R -module of level k, then H R (M) = H^(M), and 
this is either an irreducible OR-twisted W k (g, /)-module, or zero. 

(b) Let W R 'f = {w € W R \ w\ CD R +t)f = Id}. Suppose that H R {L(A)) ^ 0. Then the a R - 
twisted W k (Q, /)-modules H R (L(A)) and H R (L(A')) are isomorphic iff A' = y.A for some 
y e W R ' f . 

In the case when / is a principal (resp. "minimal" nilpotent), Conjecture B(a) was stated 
in [FKW] and [KRW], and was proved in |A2j and [Alj respectively. 

The specific choice of (depending on our specific choice of A" cw ) is very important. 
Indeed, if the property, given bv !2.2f d) (guaranteed by our choice of A" ew ), doesn't hold, then 
Conjecture B(a) fails, for example, when q = sp4 and / is a root vector, attached to a short 
root. 

It follows from Conjecture B(a) and Theorem 12 .41 that for an admissible A, ch H R^ L ^^ (r, 0, 0) 
converges for all r £ C + and does not vanish iff ch H R^ L ^^ is almost convergent. 

Remark 2.2. It follows from Theorem 12.21 that if A € Pr k,R and k = —h y + £ is such 
that pudimg^ < /i v dimg, then H R {L{A)) = 0. Moreover, if pndimg^ = /i v dimg and 
A G Prn k > R (g, f), then < dim.H R (L(A)) < 00, hence c(g,f,k) = 0. Thus, we obtain the 
following generalization of the "strange" formula: 

\P ~ ~x\ 2 = zrz - (dim g - 7: dimg 1/2 ) . 
u 12 u \ 2 'J 

This formula holds for each exceptional pair /, u (see Definition 12.31 below), and an integer 
V > h y '> ( u iP) = 1) such that pudimgf = h v dimg. 
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Conjecture C. The set Prn k ' R (Q, f) is non-empty iff k is of the form (jO.ip . where u satisfies 

(2.13) u>(6\x). 

Definition 2.3. A pair (k,f), where k G C and f is a nilpotent element of q, is called excep- 
tional if the Euler-F 'oincare character c\i h r^ a ^ of the W (q, f) -module H R (L(A)) is almost 
convergent for some principal admissible ^-module of level k, and is either or is almost con- 
vergent for all principal admissible q r -modules of level k. In this case f is called an exceptional 
nilpotent of q and its adjoint orbit is called an exceptional nilpotent orbit, and k is called an 
exceptional level for f and its denominator u an exceptional denominator. 

Recall that convergence of characters trMQ L °~ c ^ 24: of all modules M over a vertex algebra V 
is a necessary condition of rationality of V. We conclude from the above discussion that, 
provided that Conjectures B and C hold, the vertex algebra Wk(&, f) is rational iff the pair 
(k, f) is exceptional. 

Conjecture D. The vertex algebra Wfc(g, /) is semisimple iff the pair (k, f) is exceptional. 

Remark 2.3. Note that W (0,0) (resp. Wfc(g,0)) is isomorphic to the universal (resp. simple) 
affine vertex algebra V k (g) (resp. Vfc(fl)), and H R (M) = M in this case (/ = 0). Hence the 
pair (k, 0) is exceptional iff k G Z+. Since Pr k = P k in this case and all Vfc(g)-modules with 
k € Z + are {L(A)} Ae p fc mod CK [FZ], we conclude that Conjecture C (resp. D) holds if / = 

and k £ Z + (resp. / = 0). However, it is unknown whether Conjecture C holds if k is of the 
form (jO.lh with u satisfying ()2.13|) and k £ Z+ , except for the case q = sl% [AM] . E. Frenkel 
pointed out that the first part of Conjecture C follows from the special case / = 0. 

Remark 2.4. In the case when / is a principal nilpotent of a simply laced simple Lie algebra, the 
normalized characters X\,^{ T ) °f W k (g, f) coincide with those of the centralizer of Vfe(fl) in the 
vertex algebra Vi(g) <8> Vfc-i(s) [KW2]. Conjecture C in the case of simply laced g and principal 
nilpotent / would follow if the latter vertex algebra were isomorphic to Wk(g,f)- However, 
apparently this isomorphism is an open problem. 

2.6 Description of exceptional pairs, assuming positivity. The following theorem pro- 
vides an easy way to check almost convergence under the assumption that all the coefficients 
of cb-H R (L(A)) are non-negative (cf. Conjecture B(a)). 

Theorem 2.5. Let A be an admissible weight for q r and assume that all the coefficients of 
ch-H R (L(A)) are non-negative. Then c^b r (l(A)) * s almost convergent iff 

(2.14) A R C A R \A R ' f and \A R \ = |A° U A 1 / 2 ] . 

Consequently, if these conditions hold, then the eigenspace of L R with minimal eigenvalue is 
finite- dimensional. 

Proof. In view of Theorems 12.31 and 12.4] and Corollary 12.21 it remains to prove that conditions 
(|2.14p imply almost convergence. In view of the proof of Theorem 12.4] it suffices to prove the 
following simple lemma on rational functions. 
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Lemma 2.13. Let R(z u . . . , z n ) = /(*,..., ^/n^,..,^^ , 
where f is a polynomial, m(kx, . . . , k n ) G Z + and all but a finite number of them is 0. Suppose 
that all coefficients of the Taylor expansion of R(z\, . . . , z n ) at z\ = • • • = z n = are non- 
negative, and R(z Sl , . . . ,z Sn ) has a removable singularity at z = 1, for some positive integers 
S{. Then R{z±, . . . , z n ) is a polynomial. 

This lemma follows from a similar lemma in one variable. □ 

Lemma 2.14. Let R{z) = f{z)j \\ J=X {\- z^) m i , where f(z) is a polynomial in z and mj G Z + . 
Suppose that all coefficients of the Taylor expansion of R(z) at z = are non-negative and that 
R(z) has a removable singularity at z = 1. Then R(z) is a polynomial. 

Proof. Let M = £\ mj. We have: f{z) = {l-z) M h(z), and Uf^i 1 ~ zj ) mj = ( 1 ~ z ) M /20), 
where fi{z) and f2(z) are polynomials and the coefficients of f2{z) are non-negative. Hence 
fi(z) = R(z)f2(z). Since all coefficients of the Taylor expansion at z = of R(z) and f2(z) are 
non-negative and fi(z) is a polynomial, it follows that R(z) is a polynomial. 

□ 

Using Theorem 12.51 we can give a description of exceptional pairs (k, f) in terms of the Lie 
algebra q and its adjoint group G. For this we need some lemmas. 

Lemma 2.15. Let A be an admissible weight of q of level k = v/u, where u,v € Z, u > 
0,(u,v) = 1. Suppose that 

(i) (u,£) = 1, 

(ii) for each a £ A v there exists m G Z ; such that mK + a £ A^' re . 
Then A is a principal admissible weight. 

Proof. It follows from the classification of admissible weights in [KW1] that if q is simply laced 
(i.e., £ = 1), then condition (ii) implies that A is principal admissible. 

•~ v 

In the non-simply laced cases condition (ii) leaves only the following possibilities for FJ . to 

be non-isomorphic to J| |KWlj (we use the numeration of simple roots of g from the tables 
of [EE], Chapter 4): 

— -V V —V —V 

iIa =oq oIi if = Br ' ° r ' fa ° r ° 2 ; 11a = if s =i? 4. 

But the denominator u of k can be computed by the formula ^[=o = where J| A = 
{70, . . . , 7 r }, and we see by a case-wise inspection that in all cases u is divisible by £, a contra- 
diction with (i). 

□ 

Lemma 2.16. Let A G f) and Ze£ u be a positive integer, satisfying the following conditions: 

(i) (A + p|a) -Z+ for all a £ A^, 

(ii) (A|a) G iZ /or a// a G A v , 
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(Hi) (u,£) = 1. 



Then for a sufficiently large integer p, coprime to u, A = — h v )D + A is a principal 
admissible weight (of level k = —h v + p/u). 

Proof. Let p be a positive integer, coprime to u, such that p/u > (A + p\a) for all a G A v . 
Then, clearly, A is an admissible weight. Furthermore, (A + p\j£K + a) = j£p/u + (A + p\a) 
and (A + p\a) G ^Z for each a G A v . Since (u,£p) = 1, for each a G A v there exist m a , such 
that m a £p/u + (A + p|a) € Z, hence (A + p\m a £K + a) G Z. Therefore, by Lemma 12.151 A is a 
principal admissible weight. 

□ 

Lemma 2.17. Zei A G I) 6e suc/i i/iat e 2mA is an element of order u in the adjoint group G of 
the Lie algebra g, where u is a positive integer, coprime to £. Then 

(a) A)( = {a v := 2a/(a|a)| a G A A }, where A A = {a G A|(A|a) G Z}. 

f&J For a sufficiently large integer p, coprime to u, there exists a principle admissible 
weight A of level k = —h y + p/u, such that A|f, is conjugate to A fry the Weyl group W\ 
ofZ s (e 27TiA ) (the centralizer of e 2niA in g) and Z B (e 27riX l») = Z s (e 27TiA ). 

Proof. Since e 2nlA has order u, we have: a G A A implies (A|a) G Z; a G A\Aa implies 
(A|a) G ^Z\Z. Note also that a v = a (resp. £a) if a is a long (resp. short) root and 
(A|a) G ±Z\Z iff £(A|a) G ±Z\Z, since (u,£) = 1. These remarks prove (a). 

In order to prove (b), note that Z s (e 2mA ) = f) + ]CaeA A 0« > anc ^ ^ * s an integral weight of 
the semisimple part of Z 3 (e 2ntA ) (due to (a)). Hence there exists w G W\, such that A' = w(A) 
has the property that (A'|a) G Z + for all a G A A fl A+. Hence we have: (A' + p\a) G N for all 
a G AX n A\, and (A'|a) G ^Z\Z for all a G A V \A^. Then, by Lemma [2T6l there exists a 
positive integer p, coprime to u, such that A' := (— h v +p/u)D + A' is a principal admissible 
weight of level k = —h v + p/u. Since A A / = iu(A A ) = A A , because w G W\, we conclude that 
Z 3 (e 2mA ') = f, + E*eA A , 9* = Z (e 2mA ), proving (b). 

□ 

Given a nilpotent element / of the Lie algebra g and a positive integer u, coprime to £, let 

S uJ = {s£ = 1 and Z B (s) n Z 8 (f>') = f>} . 

Theorem 2.6. Assume that all the coefficients of chjjRinK)) are non-negative for all principal 
admissible weights for^g R of level k = —h y + p/u, where u > I, p > h v , (u,p£) = 1. Let f be a 
nilpotent element of g of principal type. Then the pair (k,f) is exceptional iff: 

(i) dimZ (s) > dimg^ for all s G S u j; 

(ii) dimZ (s) = dimg^ for some s G S u j. 
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Proof. Note that condition (c) of Theorem 12.31 of non-vanishing of c^-h r (l(A)) 1S equivalent to 
the condition that the element s = e 27nA ' f ' lies in S u f and satisfies (i). Also, by Theorem 12.51 
ch-H R (L(A)) i s almost convergent iff s lies in S u j and satisfies (ii). Hence conditions (i) and (ii) 
are necessary for the pair (k,f) to be exceptional. Due to Lemma 12.171 these conditions are 
also sufficient if p is large enough. But it is clear from Theorems 12.31 and 12.41 that the pairs 
(— h v + p/u, f) are exceptional for all p > h v iff one of them is exceptional for some p > /i v . 

□ 

3 Exceptional pairs for g = s£ n . 

3.1 Sheets in g = s£ n . Recall that the adjoint nilpotent orbits of q = s£ n are parameterized 
by partitions of n, and that the closure of the nilpotent orbit, corresponding to the partition 
m i > m 2 > ■ ■ ■ , contains the nilpotent orbit, corresponding to the partition ni > n 2 > • • • , iff 
m i > n i, fn\ + m 2 > Tii + n 2 , • • • [CMj . Note also that all nilpotents of si n are of principal 
type. 

In order to classify exceptional pairs we use the theory of sheets. Recall that a sheet in a 
simple Lie algebra q is an irreducible component of the algebraic variety in q, consisting of all 
adjoint orbits of fixed dimension. In the case of g = sl n the description of sheets is especially 
simple. 

Proposition 3.1. \Krf Let f be a nilpotent element of s£ n , let mi > mi > • • • > m s > be 

the corresponding partition of n, let m = mi and let m^ > m' 2 > • • • > m' m > be the dual 
partition. 

(a) The element f is contained in a unique sheet, which we denote by Shy. 

(b) All the semisimple elements in Shy are those diagonalizable matrices in s£ n , which have m 
distinct eigenvalues of multiplicities m'i,m' 2 , • • • , fn' m - We denote the set of all semisimple 
elements in Shy by Shy. 

(c) The rank of the semisimple Lie algebra [Q h ,Q h \, where h £ Shy and g h is the centralizer 
of h, is equal to n — m. 

Proposition 3.2. Let f) be the set of all diagonal matrices in q = s£ n , let f be as in Proposi- 
tion \3.1\ and assume that the centralizer of f in I) is the Cartan subalgebra of the reductive 
part of q-F . Let 

J7y = {h € f)| a(h) 7^ for any root a £ rj* of s£ n , such that a\^f = 0} . 

(a) If h G Oy, then rank [g , g h ] < n — m and dimg h < dimg-^. 

(b) IfhGtlf and rank [g h ,g h ] = n — m, then h £ Shy. Moreover, Shy = W(QfPiShf), where 
W is the Weyl group. 

Proof. We fill the boxes of the Young diagram of the partition m\ > m 2 > • • • > m s by the 
eigenvalues of h (in C n ). Then h £ Oy iff the eigenvalues in each row are distinct. Moreover, 
h £ Qf n Shy iff, in addition, all eigenvalues in each column are equal. This proves (b), due 
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to Proposition 13.1( c), Now (a) follows since making eigenvalues of h in a column unequal and 
keeping h in Qj can only decrease the rank of [fl , ] and the dimension of g h . 

□ 

Let A C h* be the set of roots of g = s£ n , and let / G g be a nilpotent element as in 
Proposition 13.11 Let A-^ = {a G A[ arL/ = 0}. We call C A a root subsystem if a € $ 
implies — a G $ and a,f3 £ a + /? G A implies a + /? G <&. The dimension of the C-span of 
in h* is called the rank of $ . Note that for each h G I) the set of roots of g h is a root subsystem, 
and its rank equals rank [fl'Sfl' 1 ]; moreover, all root subsystems of g = s£ n are thus obtained. 
Hence the above propositions can be translated in the language of root subsystems. Given a 
positive integer m, such that m < n, denote by f m the nilpotent element, corresponding to the 
partition of n of the form m = m = -- - = m>s>0. 

Proposition 3.3. (a) If C A\A^ is a root subsystem, then 

(3.1) rank$ < n - m and |$[ < |A° U A 1/2 | . 

(b) There exists a root subsystem C A\A? , such that in \3. 1\) one has equalities. In this 
case = (A U A 1 / 2 )^/. 

(c) There exists a root subsystem <3? C A\A^ such that rank & = n — m, but \&\ < |A UA 1/,2 | 
iff f ¥= fm- 

(d) If f = fm and $ C A\A^ is a root subsystem of rank n — m, then |<3?| = |A° U A 1 ' 2 ). 
Proof. Recall that 

dimg-^ = dim go + dimg 1/2 , dimgo = |A°| + n - 1 , dim0 1/2 = |A 1/2 [ . 

Note that a root subsystem $ C A\A-^ is, up to W-conjugation, the set of roots of g h with 
h G flf. Hence, by Proposition I3.2[ a). rank < n — m and |3>| + n — 1 < |A° U A 1//2 | + n — 1, 
proving (a). By Proposition E^b), for h G Sh^ one has equalities in (13. 1|) . proving the first 
part of (b). It follows from Proposition 13.21 (b) that Shj consists of semisimple elements h, for 
which \)f is conjugate to a Cartan subalgebra of [g h , Q h ] and the set of roots with respect to f)-'* 
in [g^g 71 ] is the same. Since Shj is dense in Shj, we obtain the second part of (b). 

In order to prove (c), denote by N m the set of nilpotent matrices X, such that X m = 0, 
but X 171 ^ 1 ^ 0. It is the same as to say that the first part of the partition, corresponding to 
X, equals m. Note that the adjoint orbit of f m is dense in N m . If / ^ f m , then there exists an 
element /' G N m , such that the closure of the adjoint orbit of /' contains /. If we choose /' in 
the canonical Jordan form, then rj-^ D f)^ , hence 0/ D VLf. Taking h G Sh^/ C Shj, the root 
system <3? of g h will satisfy all requirements of (c). 

If / is of the form, described in (c), then all orbits from N m lie in the closure of the orbit 
of / and all semisimple h such that rank [g' ! ',0 /l ] = n — m lie in the sheets of the nilpotents, 
contained in N m . Hence there is no h G h, such that rank [g h , g h ] = n — m, but dimg^ > dimg^, 
proving (c). (d) follows from (a) and (c). 

□ 
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3.2 The main theorems for st n . 

Lemma 3.1. Let f be a nilpotent element of s£ n , and let m be the maximal part of the partition 
of n, corresponding to f . Let A E Pr k ' R be such that <^h r (L(A)) does not vanish, where k = 
—n + ^ p, u £ N, (p, u) = 1, p > n. Then m < u. 

Proof. By definition, the root system A^ is of type hence 

— R 

Y[ A = {uqK + 70, . . . , + 7„_i}, 

where 

n-l 

(3.2) u i = u > n i ^ ^+ • 

Note that rank A R = | {i\ < i < n — 1 , Uj = 0}|. From (|3.2p we obtain 

(3.3) rankA^>n-u. 

Since, by assumption, ch.H a (L(A)) 7^ 0' by Theorem 12.3( c). A^ C A R \A R, f . Hence, by Propo- 
sition [S^a) , rank A R <n — m. The lemma now follows from (|3.3p . Q 

Theorem 3.1. Given a positive integer m < n, denote, as above, by f m the nilpotent element 
of q = s£ n , corresponding to the partition of the form m = m= -- - = m>s>0. Let 

p 

k = k„ rn = n where p G Z , p > n and (p, m) = 1 . 

m 

Then 

(a) (k,f m ) is an exceptional pair, that is the following two properties hold: 

(i) ch-H R (L(A)) either vanishes or is almost convergent for each A £ p r k ^ R - 

(ii) there exists A € Pr k > R , such that ch-H R (L(A)) does not vanish. 

(b) If k ^ kp^m and m <n, then (k,f m ) is not an exceptional pair. 

Proof. Let A € Pr k,R be a principal admissible weight of level k = ^ — n, such that ch H R^ L ^^ 
does not vanish. It follows from (|3.3p with u = m, that 

rank A^ > n — m . 

Since, by our assumption, ch-H a (L(A)) ^ 0> we have: A R C A R \A R ^ , by Theorem l2.3( c), Hence, 
by Proposition 13.2( a). rank A^ < n — m, and we conclude that rank A R = n — m. But then by 
Proposition 13. 3( b). we obtain that A^/ = (A U A 1 / 2 )^/. By Theorem \2A\ we conclude that 
ch^-H(x(A)) ^ s almost convergent, proving (i). 

Due to Theorem 12.3( c) and Propositions 13.2( b) and 13.3( d). (ii) holds as well, proving (a). 

Claim (b) follows from the following two statements: 
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(i) if u > m, then there exists A G Pr k > R , such that Af C A R \A R > f , \A R \ < |A° U A 1 / 2 ] 
(hence, by Corollary 12.21 cn H«(L(A)) is n °t almost convergent); 

(ii) if u < m, then n A R '^ ^ for any A G p r k , R (hence by Theorem 12.3( c). ^h r (L{A)) = 

o). 

In order to prove (i), let k' = k p , m , so that (k',f m ) is an exceptional pair. Then, by 
Theorem 13. 1\ there exists A' G Pr k ,R for which c^-h r (L(A')) almost converges. As before, we 
write A' in the following form: A' = (tpiy).(A° — (m — 1)^D R ), where y G W R is such that 

y(af ) = ji, (/3'|7i) = — vn! i for i = 1, . . . , n — 1 and A G P+~ n , so that we have YIa' = 
{m^K + 7i}i=o,...,n-i- Let I^i = {i\ < % < n — 1, = 0}. Then {7i}i£/ A , is the set of simple 
roots of A R , n A^. Recall that the almost convergence of <&Lh r (L(A')) implies: 

Af,nA^ = 0, ia^iaOua 1 / 2 !. 

Now fix iq G I \' and define rrij for < i < n — 1 and (3 G Y^a=i ^ a ? by the following 
relations: 

nii = m! i if i ^ zq , mj = u — m; 
= for z = 1, . . . , n - 1 . 

Then A = (^y).(A - (u - 1)%D R ) G Pr fe ' fl with Aa = {™;^ + 7i}i=0,...,n-l- Since m io > 0, 
Elf = IlA'\{7io}> hence 

A R c A# C A R \A R, f and |Af| < |A$| = |A° U A 1 / 2 ] , 

proving (i). 

In order to prove (ii), let A G Pr ' , where = {rriiK + 7i}i=o,...,n-i- Then u = 
Y^iZ® m i < m (by our assumption), hence rankA^ = [{i|mj = 0}| > n — m + 1 > n — m. 
Therefore, by Proposition 13.3( a). A R n A^ ^ 0, proving (ii). 

□ 

Theorem 3.2. Let f be a nilpotent element of s£ n , different from any of the nilpotent elements 
fm, 1 < m < n. Then (k, f) is not an exceptional pair for any k. 

Proof. Let m be the largest part of the partition, corresponding to /, and suppose that (k, f) 
is an exceptional pair, where k = — n + £, p, u G N, (p, u) = 1, p > n. Let A G Pr k,R be such 
that ch-H R (L(A)) does not vanish. Then, by Lemma [XTJ 

(3.4) m < u . 

By Proposition 13.3( c). there exists a root subsystem <& C A R \A R, f , such that 

rank<£ = n-m, |$| < |A° U A 1/2 | . 
Let = . . . ,/3 n _ m }, be the set of simple roots of $ n A^, and extend Y[$> to a set of 
simple roots f\' = {71, . . . , 7n-i} of A R . Let 70 = — Y17=l 7*> ana - define u ? G as follows 
(here we use (|3.4p ): Uo = u — m + 1, «j = 1 if 7$ G n'\n<i>> n « = if 7? G n$- Let 
n$ = { u iK + 7«|* = 0, . . . , n — 1} C A5, and let A be a principal admissible weight of level k, 

^ 

such that nA = FU- Note that a a = Hence [A^| < |A° U A 1 / 2 \, and therefore, by 
Corollary 12.21 (AihR(l(A)) ^ s n °t almost convergent. □ 
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3.3 Example of g = sl%, f = minimal nilpotent. In this case x = ^9, where 6 = ot\ + a 2 
is the highest root, g Q = I), hence A = 0, and A 1 / 2 = {ai, a 2 }. We choose ho = a\ — a 2 ; then 

r 1 /2 1 /2 

f} / = C/i , A,/ = {ai}, A_ 7 = {a 2 }, A+ ew = {a±, -a 2 , -ol\ - a 2 } = w(A + ), where w = r 2 r\. 
Therefore, 

Af = ^(A° cw ) = {-iiiT + ai , ^ - a 2 , if - ai - a 2 } , 

= t x w({ai, a 2 }) = {a x := if - ai - a 2 , a 2 := - -if + ai} , 

- — R 1 

\\ = t x w({a , ai, a 2 }) = {af := -if + a 2 , af , af } . 

We also have: 

&' = C(af + 2af ) , A f / = {af } , A? = , A J l ' 2 = {af } . 

Recall that the corresponding to / exceptional denominator is u = 2. Then (cf. Section [L2]): 

qR — loir „,R ^R ™R ™R\ 

and the corresponding set of roots is 

A§) = {2nif + a|«GA B ,neZ}U {2raif |ra £ Z\{0}} . 

Consider all possible subsets t^S^)) where y £ VF R = ta-Wi" 1 , /? £ ZAf + ZAf , Af £ f)^ = 
t x (f}), (Af |af ) = Sij, satisfying the conditions 

tpy{Sf 2) ) C Af and tpy(Af v) ) D (A*-/ = {af }) = 0. 
It is easy to see that there are two possibilities for such subsets: 

J] = t_ K (Sf 2) ) = {if - af - af , if + af : , af } and \{ = r a n(]J) . 

Since r a R\^f = 1, it follows from formula (|2.3p that Xh r (L(A)) = Xh r (L(A")) if A' an d A" are 
admissible weights, satisfying A" + p R = r a n(A' + p^). Thus, it suffices to consider only the 

I ^ 

principal admissible weights A, such that J| A = Y[ = £-Af (^(f ))• 

Since u = 2, p should be an odd integer > h v = 3, and A; = —3 + p/2. All principal 

admissible weights A of level k with ]T A = [[ are 

A = t_ A K. (A - t:D r ) = A - |(Af + D R ) mod Cif , where A £ pP~ 3 > R . 

Since = CAf , we can write an arbitrary element of f}^ as zA R , z £ C. Since dimg-^ = 4 
and h v = 3, we obtain from (|2.5|) : 

^(r,zAf,t)=e 6 ^r ? (r)0(T,z). 
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Note that for A G M p := {A - §(Af + D R )\A° G pP- 3 ' R } we have: 

A R = {2nK ± , (2n - l)if ± af , (2n - 1)K ± (af + )|n G Z} U {2niT|n G Z\0} 
(it is a root system with basis Yl\), hence 

Af >+ |^ = {(n- + a R \ ¥ , nif n G N} U {nK\n G N} . 

Since for principal admissible weights in M p we have y = 1, j3 = — A R , a straightforward 
calculation gives that in (|2.6p we have 

C(T,zA R ,t)/^(r,zA R ,t) = e~ 3mt . 

Hence (|2.6p for A G M p becomes: 

(3-5) Xh*(L{A))(t, zA r , t) = e- 3 ^XL«(A0)(2r, zA R - rAf , ~(t + ^)) . 



R 



Since dimg = 8, dimg^ = 4 and do-H R (L(A)) f° r ^ e Pr ' does not vanish only when J3 A is 

n or n i an< ^ the latter two give equal contributions. Thus, Theorem 12.11 gives the following 
transformation formula for A G M p : 



i zAl t _o^zy\ = _ 2 ^ a(A)AW(i(A , ))(T) , A « t) . 

A'eM. 



XhR(l(A)) 

where Q„(s) = ff|z 2 . 

Finally, we compute asymptotics, using Theorem 12.21 It is easy to see that Ap{zA R ) = 2 
for ft = —A R . Hence we have for A G M p , as r J, 0: 



ch^(L(A))(r,-rzAf ,0) = a(A°)e^ 
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Remark 3.1. For g = s^ n and its exceptional pair (k = —n + £ > / = /u)> where u < n, the 
"extra factor" in the character formula (|2.6p is independent of z, and is given by the following 
formula: 

s'-l 

C(t,z,*) ^ ^ 6 /frl-^' 1 



where ± = (-1) JA , a(t) = e* 1 **^ -1 - 1 )*, 6 = (s - - s - l)(stt - s 2 + u)/24u, s is the 
remainder of the division of n by u, s' = min{s, u — s}, and 



i=i \j=i 

In particular, the "extra factor" is equal to ±a(t) if s' = 1, and to ±a(t)r/(r) / 'ry(ur) if s' = 0. 
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3.4 Conjectures. Let be a simple Lie algebra, and denote by Eq the set of all non-principal 
exceptional nilpotent orbits of 0. Let h be the Coxeter number of q, and let Iq denote the set 
of integers j, such that 1 < j < h and (j, t) = 1, where £(= 1, 2 or 3) is the lacety of 0. 

Conjecture E. There exists an order preserving map (p : Eq — > Iq, such that all exceptional 
pairs (k, /), for which / is not principal, are as follows: / lies in an orbit from Eq, k = — /i v +^yy, 
where p £ Z, p > h v and (p, <p(f)) = 1. 

Recall that all adjoint nilpotent orbits of 3 = so^r, -/V odd (resp. spn, N even) are inter- 
sections of nilpotent orbits of s£n with g, if they are non-empty, and these intersections are 
non-empty iff all even (resp. odd) parts of the corresponding partition of ./V have even multiplic- 
ity. In the case g = son, N even, the answer is the same, as for q = son, N odd, except that in 
cases when all parts of the partition are even, the intersection consists of two orbits, permuted 
by an outer automorphism of son, which we shall identify. Furthermore, a nilpotent orbit of 
= son or spn is of principal type if either the multiplicities of all parts of the partition of N 
are even, or else one has respectively: 

= spN, and exactly one even part has odd multiplicity, 

= son, N odd, and exactly one odd part has odd multiplicity, 

= son, N even, and exactly two distinct parts, one of which is 1, have odd multiplicity. 

Conjecture F. Let be son or spn- Let m be a positive integer, and denote by N m the 
set of matrices {X £ Mat^ n g\X m = 0}, and let m be the adjoint orbit, open in N m (such 
an orbit is unique if 7^ so^ n or m is odd). Denote by Fq the set of all non-principal adjoint 
orbits m of principal type with m odd. Then Fo C Eq and f(0 m ) = m for m G Fq. 

Conjecture G. 

(a) If = so 2n +i or sp 4 n+2, then Eq = Fq. 

(b) If = spi n , then Eq = {Fo , &2n,2n}, where 02n,2n denotes the nilpotent orbit, corre- 
sponding to the partition 4n = 2n + 2n, and <~p(02n,2n) = 2n + 1. 

(c) If = so2n, then Fq consists of all exceptional nilpotent orbits with (p(0) odd. 

We checked conjectures E, F and G for N < 13. 

Examples 3.1. (a) = sos- Then Fo = {Fo , 03,2,2,i}> where 03,2,2,1 is the nilpotent orbit, 
corresponding to the partition 8 = 3 + 2 + 2 + 1, and </?(03,2, 2,1) = 2. (Note that 03,2,2,1 
is not open in N3.) 

(b) = so 10 . Then F = {F , 3 ,2,2,i,i,i}, and <£>(0 3 , 2 ,2,i,i,i) = 2. (Note that 3 ,2,2,i,i,i is 
not open in N3.) 

(c) = S0 12 . Then Eq = {Fq, 05,3,3,1, 03,2,2,2,2,1, 03,2,2,1, 1,1, l,l}, and ¥>(05,3,3,l) = 4, 

^(03,2,2,2,2,i) = ¥>(03,2,2,i, i,i, 1,1) = 2. (Note that 5 ,3,3,i is not open in N 5 and 03,2,2,2,2,1, 
03,2,2,1,1,1,1,1 are not open in N 3 .) 
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(d) g = G^- Then the only non-zero non-principal exceptional nilpotent orbit is the orbit 
of a root vector e a , where a is a short root, and <p(0) = 2. This is the simplest case when 
the extra factor in (|2.6p does depend on z: 

C(r,z,t) _ e _ 47ri4 f(r,z) 



il>(r,z,t) f(2r,2z) 
where /(r, z) is defined by (|2.7p . 



3.5 Corrections to [KRWj and [KW4j. 

1. The last sentence of Proposition 3.3 in [KW4] should be changed as follows (cf. Theo- 
rem [2]3] of the present paper): 

Then ch^tw (r, h) is not identically zero iff the character of the g tw -module M has a 
pole at all hyperplanes a = 0, where a are positive even real roots, satisfying the following 
three properties: 

Similar change should be made in Theorem 3.2 of [KRWJ. 

2. The first factor on the right of formula (3.14) in [KW4] should be replaced by the following 
expression: 

3. The convergence of characters argument in the proof of Theorem 3.1 in [KRW] should be 
changed as in the proof of Section T2.2I of the present paper. In particular, one should add 
there the assumption that / is of principal type. 

3.6 Appendix: on representations of W^ n (g, f). The associative algebra W Rn (g,f) is 
obtained by quantum Hamiltonian reduction as follows [Fj, |GG] . Let g>i = ®j>i0j and let 
X '■ 0>l C be a homomorphism, defined by x( a ) = (/ 1°0- Extend x to a homomorphism 
X ■ U(g>i) — ► C and let I x C U(g>i) be the kernel of %■ The subspace I x is invariant with 
respect to the adjoint action of g +1 hence the left ideal U(g)I x of U(g) is ad g + -invariant as 
well, and we let 

W {in (g,f) = (U(g)/U(g)I x T d »+. 

It is easy to check that the product on U(g) induces a well-defined product on W Kn (g,f). We 
thus obtain the finite W -algebra, associated to the pair (g, /). 

For the purpose of representation theory it is more convenient to use an equivalent definition 
of W (g, f), similar to that of W (fl, /) (equivalence of these two definitions was proved in 
the appendix to |DK| ). Let Cl(g,/) denote the Clifford-Weil algebra on the vector superspace 
A C Yi © A ne with the bilinear form ( . | . ) © ( . | . ). Let C(g, f) = U(g) <g) Cl(g, /), and introduce 
the following odd element of C(g, /): 

QG5+ a<=S 1/2 a,f3,-y£S + 
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(This element is obtained from d(z) in Section 12.11 by dropping z and the signs of normally 
ordered product.) Then d 2 = ^[d, d] = 0, and we have [DKJ: 

W M (gJ) = H(C(g,f), a d d). 

As in |KW3j or [DK], one proves that this homology is concentrated in th degree with respect 
to the charge decomposition, defined by 

(3.6) charge u a = charge <j) a = , charge ip a = — charge v?" = 1 . 

Recall the construction of A2. ew C A in Section 12.21 and let 



Rf = {a G ±A* ew \a(x) = j} , i?+ = U J>0 R+ , R~ = U j>0 Rj . 

Let S(g, f) denote the irreducible Cl(g, /)-module, generated by the even vector |0), subject to 
the conditions: 

(f) a \0)=0 if aeR+ /2 , <p a \0)=0 if a G R+ f a \0) = if a € i?> . 

As in Section 12.21 given a g-module M, we can construct the complex 

(C(M) = M®S(gJ),d). 

It is a Z-graded C(g, /)-module C(M) = (Bj<=zCj(M), where this charge decomposition extends 
(I3.6p by letting charge M = 0, charge |0) = 0. We thus obtain for each jsZa functor Hj from 
the category of g-modules to the category of V^ fin (g, /)-modules, given by: 

Hj(M) :=Hj(C(M),d). 

As in Section 12.21 we prove the following proposition. 

Proposition 3.4. Assume that f is a nilpotent element of principal type. Let M be a highest 
weight g-module with respect to A 1 ! ™, so that cb.M(h) = ^ HM^H. _ h G t). Then the 

Euler-Poincare character ch H ^ M j of the W Rn (g, f) -module H(M) = ®j e zHj(M) is given by: 

(3.7) ch g(M)W= n ^ hetf. 

We rewrite formula (|3.7f) . using the Kazhdan-Lusztig formula for nu w _^\, where w G W 
and A + p is an integral regular anti-dominant weight: 

(3-8) n L(w . A) = e(y)e(w)P y , w (l)e yA , 

yew 

where Py }W (q) are the Kazhdan-Lusztig polynomials. 

Since / is a nilpotent element of principal type it can be written as a sum of root vectors, 
attached to roots 71, . . . , j s , where 74 — 7^ ^ A U {0} for i ^ j, and 7jL/ = 0. Denote by W$ 
the subgroup of W, generated by reflections in the 7i, i = 1, . . . , s. 
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Since e s ~*L/ = e A |[j/ for s € W?, we obtain from (|3.8p : 

»x( W .a)If,/= X] e ( s y) e ( w ) p ^"'( 1 ) e(sy) ' A l^ 

sew' 

= £ 6(y)6H ^ 6( S )P^(l)e^ A |^ . 
y eVK/\w sew/ 

We thus obtain the following proposition. 

Proposition 3.5. Assume that f is a nilpotent element of principal type. Let A + p be an 
integral regular anti- dominant weight and L(w.A) an irreducible highest weight g-module with 
respect to A*Y: W . Then 



where Py tW (q) = Y^sewf e ( s )Psy,w 

The following conjecture is a "finite" analogue of Conjecture B. 
Conjecture H. 

(a) If M is an irreducible highest weight g-module (with respect to A" ew ), then H{M) = 
Hq(M), and this is either an irreducible iy fin (g, /)-module, or zero. 

(b) Suppose that / is of principal type and H(L(A)) ^ 0. Then the VF fin (g, /)-modules 
H(L(A)) and H(L(A')) are isomorphic iff A' = y.A where y € . 

(c) All finite-dimensional irreducible VF fin (g, /)-modules are contained among the Hq(L(A)). 

In the case when / is a principal nilpotent in a Levi subalgebra, it was conjectured in 
[DVJ that the right-hand side of formula (|3.9p gives the character of an irreducible highest 
weight iy fin (g, /)-module. Due to Proposition 13.51 this conjecture (in the more general case of 
a nilpotent element of principal type) follows from Conjecture H(a). 
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